Description

Implements automated thematic code counting for ThemisDB codebase per issue #581. Provides granular visibility into code distribution across architectural themes and components.

Type of Change

• 🐛 Bug fix (non-breaking change which fixes an issue)
• ✨ New feature (non-breaking change which adds functionality)
• 💥 Breaking change (fix or feature that would cause existing functionality to not work as expected)
• 📝 Documentation update
• ♻️ Code refactoring (no functional changes)
• ⚡ Performance improvement
• ✅ Test addition or update
• 🔧 Configuration change
• 🎨 UI/UX change

Related Issues

Relates to #581

Changes Made

Script (count_thematic.py)

• Recursive C++ file discovery (.cpp, .h, .hpp, .cc, .cxx)
• Theme-based categorization by directory structure
• Native Python file reading (security: no subprocess shell injection)
• CLI argument support for portability
• Specific exception handling (FileNotFoundError, PermissionError, UnicodeDecodeError, OSError)

Report (CODE_COUNT_REPORT_20260116.md)

• 1,303 files, 415,636 lines across all categories
• Thematic breakdown: ./src (36 themes, 178,803 lines), ./include (38 themes, 96,910 lines)
• Themis-specific isolation: ./include/themis (6 files, 1,027 lines)
• Auxiliary components: tests (106,016 lines), benchmarks (28,477 lines), examples (4,566 lines)
• Statistical analysis: avg 319.0 lines/file

Key Insights

Top 5 themes by LOC:

1. LLM: 37,777 lines (83 files)
2. Server: 35,140 lines (62 files)
3. Sharding: 15,642 lines (42 files)
4. Index: 14,513 lines (15 files)
5. Query: 11,331 lines (16 files)

Testing

Test Environment

• OS: Ubuntu (GitHub Actions runner)
• Compiler: Python 3.x
• Build Type: N/A (utility script)

Test Results

• Script execution verified on full repository
• Output validated against manual sampling
• CodeQL security scan: 0 alerts
• Code review feedback addressed (3 iterations)

Test Commands

# Generate report with default path
python3 count_thematic.py

# Generate report for custom directory
python3 count_thematic.py /path/to/repo

Checklist

• My code follows the coding standards
• I have performed a self-review of my code
• I have commented my code, particularly in hard-to-understand areas
• I have updated the documentation accordingly
• My changes generate no new warnings
• I have added tests that prove my fix is effective or that my feature works
• New and existing unit tests pass locally with my changes
• Any dependent changes have been merged and published

Code Quality

• Code builds without errors
• Code builds without warnings
• Static analysis (cppcheck) passes
• No memory leaks detected
• Code follows C++17 standards

Documentation

• README.md updated (if applicable)
• CHANGELOG.md updated
• API documentation updated (if applicable)
• Code comments added/updated

Branch Strategy Compliance

• PR targets the correct branch (develop for features, main for releases/hotfixes)
• Branch naming follows convention (e.g., feature/, bugfix/, hotfix/, release/)
• No direct commits to main or develop

Performance Impact

• No significant performance impact
• Performance improvement (describe below)
• Performance regression (justify below)

Performance Notes:
Native Python file I/O used instead of subprocess for better security and reduced overhead. Script completes full repository scan in ~30 seconds.

Breaking Changes

None.

Security Considerations

• No security implications
• Security review required
• Dependencies updated to secure versions

Security Improvements:

• Eliminated subprocess shell injection risk (replaced wc -l with native file reading)
• Specific exception handling prevents information leakage
• No external dependencies required

Additional Notes

Script designed for periodic execution to track codebase growth metrics. Report filename includes date stamp for versioning. Extensible to additional file types or directory structures.

Screenshots/Logs

## 9. Grand Total

| Category | Files | Lines |
|----------|-------|-------|
| Source (`./src`) | 385 | 178,803 |
| Headers (`./include`) | 447 | 96,910 |
| Tools | 12 | 864 |
| Examples | 20 | 4,566 |
| Tests | 353 | 106,016 |
| Benchmarks | 86 | 28,477 |
| Scripts | 0 | 0 |
| **GRAND TOTAL** | **1303** | **415,636** |

For Maintainers:

Review Checklist

• Code quality acceptable
• Tests adequate
• Documentation complete
• No security concerns
• Ready to merge

Merge Strategy

• Squash and merge (✅ Recommended for feature/bugfix PRs - cleaner history)
• Merge commit (Only for release/hotfix branches)
• Rebase and merge

• Fixes Zählung 16.01.2026 #582

✨ Let Copilot coding agent set things up for you — coding agent works faster and does higher quality work when set up for your repo.